The Multi-path Utility Maximization and Multi-path 

TCP Design 



Phuong L. Vo, Anh T. Le, Choong S. Hong 

Department of Computer Engineering, Kyung Hee University, Korea. 



Abstract 

The network utility maximization problem (NUM) for multi-path is a 
problem which is non-strictly convex and non-separable. Using Jensen's in- 
equality, we approximate the NUM to a strictly convex and separable problem 
which can be solved efficiently by the dual decomposition method. After a 
series of approximations, the result of the approximation problem converges 
to the globally optimal solution of the original problem. 

Moreover, because of the separable and dual-based natures of the pro- 
posed algorithm, we utilize the reverse engineering frameworks of the current 
TCPs to develop a series of multi-path TCPs which are totally compatible 
with current TCPs. The multi-path users using our protocols can run simul- 
taneously with the single-path users using the current TCPs. The simula- 
tions of our Multi-path Reno on ns-2 show the compatibility and the fairness 
among multi-path and single-path users. 

Keywords: network optimization, fluid model, multi-path TCPs 
1. Introduction 

In the multihop networks with the sets of sources M and links C. Let N 
and L be their cardinalities, respectively. The network utility maximization 
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(NUM) problem for multi-path is given by 

Rs 

Main Problem : Max. U s ( x s ,i) 

s - t - ^2 Xs ' i - ° u ^ l E ^ 

where U s (.) is a concave function associated with source s, lZ St i is the i-th 
path of source s, 1Z S = {H s ,i, H Sl 2, • ••} is set of paths associated with source 
s, and R s is its cardinality (number of subflows). Let x St i be the allocated 
rate on i-th path of source s, x si E [x™ m , xff*]. 

ieiZs Xs >«) * s a non-strictly concave function and is also non-separable 
among x s ^. As a result, Main Problem is a non-strictly convex and non- 
separable optimization problem. In many of current works on multi-path 
NUM, 0,0, SUB [fl , the authors perform either subtraction or addition of 
a strictly convex or concave function to the objective in order to transform 
Main Problem to a strictly convex problem. This new problem is solved 
distributively by primal approach or dual approach. The results are glob- 
ally optimal solution. However, the new strictly convex problems remain 
non-separable, so these previous mentioned works do not fully model the 
case of a multi-path user having paths with different characteristics, for ex- 
ample, different round-trip-times. On the other hand, the current TCPs are 
window-based update protocols whereas the algorithms in [l], 0, 0, 0, 0, 0] are 
rate-based updates, hence, it is quite difficult to deploy them to the current 
Internet. 

In this paper, we apply a novel method to solve Main Problem which 
overcome the mentioned issue. The original problem is approximated to a 
new optimization problem which has a strictly concave objective. After a 
series of approximations, the solution to the approximation problem which is 
obtained by dual-based approach converges to the globally optimal solution 
of the original problem. Our algorithm is distributively implemented. To 
adapt the rate allocation of each path, each source depends on the local 
information, which is the total rate of all paths and the congestion-price 
feedback of paths. 

Going further than the previous works on fluid model, we establish a 
connection between the theoretical model and the practical design of multi- 
path TCPs. Utilizing the separability of the new approximation problem and 
the dual-based approach of our algorithm, we design a series of the multi-path 
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TCPs based on the reverse engineering frameworks of the current TCPs, 
Ours multi-path TCPs is totally compatible with the current TCPs, so that 
the multi-path users can fairly cooperate with the single-path users. 

The successive approximation approach is introduced in jsf and it is 
usuall y appli ed to geometric programming in power control problems, such 
as 0, 0, 11 1, to approximate the non-convex capacity constraints. (9| con- 



tains an interesting overview about this method. In this paper, we utilize this 
method to approximate the non-strictly concave objective into a new strictly 
concave one. Our previous work also uses this method to approximate both 
objective and power constraints of NUM in a joint power and rate control 
for multiclass traffic in wireless networks, (li| . 

The structure of the paper is organized as follows: Section II presents 
the approximation problem, the successive approximation algorithm, and its 
convergence in fluid model. Section III introduces multi-path Vegas, multi- 
path Reno and more general form of multi-path TCPs. And finally, the 
Multi-path Reno experiments and conclusion are presented in Sections IV 
and V, respectively. 

Notations: Throughout the paper, we use italic characters to denote vari- 
ables and bold characters to denote vectors. For example, x s = [x s ,i,x Si 2, ■■■} T 
is the rate vector of all paths from source s, and x = [xf , x|\ ...] T is rate 
vector of all paths from all sources. Similarly, 9 S ^ is the auxiliary variable 
associated with path i of source s, 6 S = [9 S ^, 9 St2 , ...] T , and 6 = [d\, 0^, ...] T . 



2. Analysis 

2.1. Approximation problem 

We know that if /(.) is a concave function, the Jensen's inequality /(X^i 9 s ^z,j) > 
J2f=i 9 s ,if{zi) holds for all S y and 1 T 6 S = 1. After replacing x Sj i = 9 s ^z^ 
we obtain the following inequality 

i/,(EiM)>Ew(r)' (1) 

i=i i=i s ' 1 

Note that the equality of ([I]) holds if 

9 s ,i = -Sr ^ = ••' R » s = l,-.,N. (2) 
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By denoting U S! i(x s /, 9 Si i) = 9 St iU a (J^), the function of x Sj i parameterized 
by 9 St i, we have the approximation of Main Problem as follows 



Approximation Problem : 



(3) 



N R s 



Max. 

8=1 i=l 
N 

s.t. ^2 ^2 Xs ' 1 - ° u ^ e ^ 



s=l i:leTZ s 



Approximation Problem is exactly the basic NUM problem in which a 
new separate and strictly concave utility is associated with each subflow. 
Therefore, the network treats each subflow as a separate flow. Now, we 
can solve Approximation Problem by the dual decomposition method as de- 



scribed in 13 



The dual function is given by 

/ N R s 

D(X) =max ( ^ ^2 U sA {x Sii ; 6 a ,%) 



N 



=1 i=l 



N R s 



=1 i=l 



^ ^ max ( U Sji (x S;i ; 9 S:tJ 



1=1 s=l i:l£lZ a ,i 

\ L 
( ^2 ty x '* ) +^2 c i^i 



leils.i 



(4) 
(5) 



i=i 



and the dual problem is min^o D(X). 

Let q s> i(t) = • "MO ^ e ^ ne congestion price of z-th path from source 

s. Because the subproblem max Xgi (lf Sj i(x S) i] 9 Sti ) — (J2ien s * ^i) x s,^j is a con_ 
vex problem, its solution also satisfies the KKT conditions. From the first 
derivative condition, we have the rate update for each subflow is given by 



x tti (t + l) = \u' s f(q s M^s,i) 



(6) 



where [a] b c = max(min(a, h), c). 

Applying the projected gradient algorithm to the dual problem, we obtain 
the congestion price update of each link as follows: 



N 



Xl(t+1) = [\l(t)+K(^2 X s,M~ c l 

s=l i:l£TZ 3 i 



V/ G C, 



(7) 



where stepsize k is sufficiently small for the convergence of the algorithm and 
[a] + = max(a, 0). 

2.2. Successive approximation algorithm for multi-path 
Algorithm 1. Initialize x = and 9 S i = 4- ; in the r-th iteration, 

1. Each source updates 9 Sti according to fl2]) with a£°(r — 1) which is the 
result of the previous iteration; 

2. With updated 6 S , source s updates the transmit rate of its paths accord- 
ing to (jBJ), and links update their prices by (j7|) until convergence to the 
stationary point x°°{t); 

3. Increase r and go back to step 1. 

Theorem 1. Algorithm [J\ converges and the stationary point satisfies the 
Karush-Kuhn-Tucker conditions of Main Problem. 

Proof. We define some parameters for convenience as follows: 

• x°(r), the initial point of step r; 

• x°°(t), the stationary point of step r; 

• C(x)^Ef=i^(E£i^);and 

• Cr(x; 0) = EfLi Y^f=x U s ,i ( x s,i\ ®s,i) > the function of x parameterized by 

First, we prove the convergence of the algorithm. The solution of Ap- 
proximation Problem indeed monotonically increases the objective of Main 
Problem in each step: 

G(x°°(t-1)) = G(x o (t);0(t)) (8) 
<G(x°°(t);0(t)) (9) 
< G(x~(r)). (10) 

x°° (t— 1) 

(JED is obtained by replacing 6» Sji (r) = Ha s - 1 - — - and x°(r) = x°°(r - 1), 

fTTUj) is satisfied because of ([T]). Moreover, G(x) is always bounded since x is 
bounded, therefore, Algorithm 1 converges. 

Now we prove that the stationary point of Algorithm 1 is also the KKT 
point of Main Problem. Define (x*, A*) be the solution of Approximation 
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Problem along with 0*. Thus, (x*, A*) is also the KKT point of Approxima- 
tion Problem. 



VG(x*; 0*) - q* = 0, 



N 



A *QC E < 4 -Q) = 0,V/G£, 



s=i i-.ieKs 



N 



E E x U ^ c <> 



8=1 i:leH s 

a; > o, 



(ii) 

(12) 

(13) 
(14) 



where q = [qf, qf\ q^] i s congestion price vector of all paths for every 
sources. 

We prove that (x*, A*) also satisfies the KKT conditions of Main Problem. 
Observe that 



0G(x) 



dx. s 



dUJx) 



dx 



<9G(x; 0) 



x s =x! 



and similarly, it is the same for the proof of all other partial differential 
equations. Therefore, VG(x*; 0*) — q* = VG(x*) — q* = 0. The remaining 
conditions are kept the same. Thus the second statement is proved. □ 

Main Problem is a convex optimization problem even though the objec- 
tive is not strictly concave. So the KKT point is also the global optimum of 
the original problem, 14j. As a result, Algorithm 1 converges to the glob- 
ally optimal rate allocation. Moreover, 8 S can be updated distributively and 
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asynchronously among sources because the total utility monotonically in- 
creases each time 6 S is updated and the information required for the update 
is just the local information from source s, the total rate of subflows. 

Algorithm 1 has two levels of convergence. The outer iterations update 
6 S and the inner iterations are exactly the standard dual-based algorithm 
with the new utility function. Theoretically, the number of inner iterations 
must be large enough for the convergence in every outer steps. However, if 
the number of inner iterations just guarantees that there are a nondecreasing 
in the aggregate utility, then the formula (Q still hold and the algorithm 
still converges. The standard dual algorithm decreases the dual function 



monotonically in every steps if the step-size is sufficiently small (see [f 3|). 
but usually does not guarantee that the objective of the primal (the aggre- 
gate utility) monotonically increases. However, because the convexity of the 
primal problem, the duality gap tend to zero, and then the aggregate utility 
always tends to increase to the maximum point (for a fixed 6 within an outer 
step). As the result, we still have the convergence of the algorithm with not 
very large number of inner iterations. The Matlab experiment in session IV. a 
will demonstrate this observation. 

Remark 1. In case utility is an a- fair utility 

j log(x), if a = 1, 

assuming x* be the global optimum of Main Problem, the inequality VG(x*) T (x- 
x*) < always holds for all feasible point x because of the concavity of G(x). 
Therefore, 

N R " x — x* N x X* 



-' ^ (V s x , 

= 1 i=l \Z^j=l ^Sj/ s=l 



where x s = Ylf=i x s,j- So we still have the a-fairness among sources in the 
multi-path environment. For example, we have proportional fairness with 
a = 1, harmonic mean fairness with a = 2, and max-min fairness with 
a = oo, tla l. 



3. Multi-path TCPs 

In this section, we want to design new multipath TCPs (MTCPs) base 
on the above theoretical analysis. There are three main targets we want to 
focus when designing MTCPs: 
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1. MTCPs must be compatible to the current single-path TCPs. The 
multi-path users can run simultaneously with the single-path users 
which are using the current TCPs in a same network. 

2. The model must address the mismatch parameters between paths from 
one source, such as different backlog packets in Vegas or different round- 
trip-time in Reno. 

3. The protocols can be implemented online. 

From the work of S. Low, [7], we know that the current TCPs are the 
implicit solutions to the NUM problems with particular utility functions. All 
of these functions are concave functions. Thus, we can apply our approxi- 
mation inequality ([T]) to the NUM's objective. The approximation problem 
is exactly the basic NUM which each path is treated as a single-path flow 
associated with a new strictly concave utility parameterized by 9 S ^. However, 
it is clear that the second target cannot be satisfied because the Algorithm 1 
does not address the specific parameters for each route. On the other hand, 
to address the first target, the function U{.) should have the form similar to 
the utility functions of the current TCPs. The 6 update in MTCPs should 
become 1 in case of single-path users. And with 9 = 1 for single-path users, 
the utility function, rate update, and window change of MTCPs should be- 
come exactly the ones of the single-path users. Therefore, we cannot apply 
the approximation inequality ([T]) directly, we use the modified approximation 
coefficient 9 instead of 9. 

An notification in online implementation is that the number of inner 
iterations is fixed in N iterations which is not so large as the notice in the 
analysis. After N iterations, is updated. The following subsections are 
three examples of deploying our theoretical framework to design three new 
multi-path TCPs, which are compatible to their corresponding TCPs: Vegas, 
Reno, and general Reno. 

3.1. Multi-path Vegas (mVegas) 

TCP Vegas for single-path has the implicit utility function U s (x s ) = 
a s d s \og(x s ), where d s is propagation delay of path associated with source 
s and a s d s is the number of backlog packets on the path, which is denoted 
by b s . We choose the utility function of the multi-path users as follows 




(17) 



i=i 
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where 6™ m = mmi{a S jd Sj i}, as the general form of the utility function for 
multi-path users. 

The approximate inequality is modified as follow 



Rs Rs 



K in log ( E x Sti ) > vr E e ^ ] °g (it) ( 18 ) 

i=l i=l S ' 1 

, ^min . 

= Em*>s(- £ --^J (19) 

Rs 

= E^.feM> (20) 

i=l 

where fe s> j = a Sy id Sy i is the number of backlog packets on i-th path of source 
s, and 

^min ^min ^ 

B a ,i = f-0 s ,i = I R s s '\ ' ( 21 ) 

for the equality holds. Note that if mVegas has same number of backlog 
packets on subflows from one source, then we still have 9 s ,i = S ^ = „r°' 1 — 

as normal. 

At the equilibrium point, we get the following formula from fl6]) 

*.,<(*) 0,,^- ^,^4f- (22) 
q s ,i{t) qs,i{t) 

As the result, we obtain the window update and rate update for multipath 
Vegas in one time slot as follows 

hs,M + it " ~ifr~~ ~ ~jt^~~ < 

w.,i{t + l) = {w.dt)-£ i if ^ - ^ > 0s,'^,- (23) 
\ w s,i(t) otherwise, 

ar.,i(t+l)= L i (t) + -^l(^^4f -^(t))j + , (24) 

where l(z) equals 1 if z > 0, -1 if z < 0, and if z = 0, -D Sj j is the round-trip- 
time of path i, the total of propagation delay d Sii and queueing delay q s ^. 
We can see a slight difference in the update of each subflow in mVegas from 
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normal Vegas. In each RTT, the window size of subflow increases by 1 if 
Ws f® — Ws ' i( 3 < Q si a s i and decreases by 1 if Ws f^ — ™n'^ > 0$ i&s % (instead 
of comparing to a s as in Vegas). In case of single-path user, 9 is always 1, 
hence, f l2"lj) and (T2"3"j) become exactly the rate and window updates of TCP 
Vegas for the single-path users, Q. Therefore, mVegas can coexist with the 
current Vegas. The price of links, which are actually the queue size, are 
implicitly updated, and the total congestion price of the path is feedbacked 
to source in the acknowledgement packets. 

3.2. Multi-path Reno (mReno) 

The utility function of Reno for single-path user is given by U s (x s ) = 

tan -1 ^^/|D s x s j, where D s is the RTT of the path. So we construct 
the utility function for multi-path users as follows 

^(*.) = #t»- l (vf fl r'"X><.<)< <w 

s i=l 

where D™ m is the minimum RTT over all paths of source s. In order for U(.) 
to have the similar form to the single-path utility, 6 S)i is selected such that 



or 



„ n min 

a ^ - V fl s ~ D ■ 



The approximation inequality becomes 



v ; ~ Df m 4^ VV 3 s 9 s4 



i=i 

R. 



Z-i D s>i S ' J W 3 9 

i=i ' 



R 

A 



J2Us,i( x s,iJs,i)- (27) 
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We get the equation q s 



at the equilibrium point and then 



2.r- 



'-+3 



we construct the rate update of mReno in one time slot as follows 



x.,i{t + l)= x Sii (t) + 9 2 s , 



2 1 - psAtKS) 



(28) 



and from the fact that x = jj, we have the window changing in 1 time slot 



%<(1 -?.,<(*)) 



(29) 



This means that in one round-trip-time, the window size of each subflow in 

mReno increases by 8 2 , each time the source receive ACK on that subflow 

n 

and decreases by half if noto 



Remark 2. If the round-trip-time is very large, 2Xs ® B 1 ; then q s = 2 x\dI 
and the utility function of Reno becomes U s (x s ) = — 2 3 D2 , a utility in the 
a -fairness family with a = 2. 



3.3. More general Multi-path TCPs 

The general TCP algorithm increases the rate by A s (x s (t)) with each 
positive acknowledgement, and decreases it by B s (x s (t)) with each negative 
acknowledgement. So the rate update has the form of 

x s (t + 1) = [x s (t) + (1 - q s (t))x s (t)A s (x s {t)) 

- q s (t)x,(t)B a (x a (t))Y . (30) 

And the utility function for the reverse engineering model is given by, [?} 

A s (x) 



UJx, 



A.(x)+B.(x) 



-dx. 



(31) 



In case of AJx s ) 



TCP of which the utility function is 

UJx.) = 



tt i , )/ 2 and B s (x s ) = bx s D l s 1 we have Binomial 

-dx (32) 



1 



1 + 2(D 8 z)*+'+i 



1 The factor 1/2 is usually replaced by 2/3 when describing the TCP behavior in the 
mathematical model. 
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and with k + I = 1 and | = |, we have the series of TCP-friendly protocols. 
For example, with (k,l) = (0, 1), Binomial TCP becomes Reno. 

We also want to construct the MTCP bases on the general TCP that can 
coexist with the general TCP. The utility of source s for MTCP has the form 



In case of Binomial MTCP, 



Us(x s ) = / rz —-—-dx. (34) 

^■>A-r,y.^,) = ^,.i I "' , , b ^L„^ k+l+1 dx (35) 



Therefore, 

x s.i 

1 



l + ±(D?™x) 



Also by replacing 9 S j = -t^9 s , and changing the variable y = Ds n — x 
in ( 135]) . we obtain 

= / o i + n ai £^ y) k + i + i dy (36) 

Hence, the rate update for the binomial MTCP is given by 

x Bji (t + 1) = x s>i (t) + (l - q s ,i(t))x Sii (t)A s (x sA (t)) 

- q a ,i(t)x 8ti (t)B s (x 8l i(t)) (37) 
x .m + g§ k+2 



b 





S.I 



n <U"--{y . (38) 



Remark 3. In mReno as well as general mReno utilities, we can choose 
or Df ei instead of D™ m . Whichever value we choose, it plays the 
compatibility role for the multi-path TCP to the single-path flows, therefore, 
the single-path TCP does not need to change. On the other hand, using _D™ in 
means that the network will treat the multi-path user as a single-path user on 
the path with the minimum round-trip-time. This also keeps fairness among 
single-path users and multi-path users. This is quite a reasonable thinking in 
multi-path routing. 
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Figure 1: Network with two links. 

4. mReno experiments 

4-1. Matlab simulations 

The network in the first experiment has two bottleneck links and three 
users, one multipath user and two single-path users as in Figured] In Matlab 
environment, we approximate the RTT to double of the propagation delay. 
The capacities of links are all 4 Mbps. 

Algorithm [1] is run in Matlab environment to observe the convergence of 
the algorithm and the theoretically optimal solution. The number of inner 
iterations N = 20. The constant stepsize k = 10 -5 is used. In all of following 
Matlab's experiments, we always have the optimal results same as the ones 
archived by iterating the inner loops till convergence before updating (using 
the diminishing step-size). 

In case of same RTT and the propagation delays 50ms for both paths, it 
is quite straightforward that the algorithm converges within the first outer 
step. The evolutions of rate (of flows and subflows) and aggregate utility 
are nearly horizontal lines. The rates of multipath user and two single-path 
users are all equal to 2.66 Mbps, and two subflow also have the same rate at 
1.33 Mbps. 

Figures |2] (a) and (b) show the rate evolutions of flows and subflows in 
case of different RTT, propagation delays are 50ms for path 1 and 200ms for 
path 2. The multi-path user has the same optimal rate as the single-path 
user 1 which has shorter RTT and higher than the optimal rate of single-path 
user 2. This result agrees with the analysis that the network treats multipath 
user as a single-path user with the minimum RTT. Figure M,c) is the plot of 
aggregate utility vs. outer iterations. It monotonically increases after each 
outer step. 

In the next experiment, we monitor the network for 10000 iterations (ap- 
proximate to 1000 seconds), and the users are on/off as follows: 
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^ 3 



muiti-path 

single-path 1 

single-path 2 



200 300 400 

iterations 



500 600 




subflow 1 

subflow 2 



200 300 400 

iterations 



500 600 



(b) 



Figure 2: Rate of users and sub-flows on Matlab in case of different round-trip-times, 
2-bottleneck-link network. 
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Table 1: The theoretically optimal values. 





(MP,SPi,SP 2 ) 


(subffowi, subffow2) 


same RTT 






phase 1 


(8,0,0) 


(4,4) 


phase 2 


(4,4, 0) 


(4,0) 


phase 3 


(2.66,2.66,2.66) 


(1.33,1.33) 


phase 4 


(1,0,0) 


(4,4) 


different RTT 






phase 1 


(8,0,0) 


(4,4) 


phase 2 


(4,4, 0) 


(4,0) 


phase 3 


(3.55,3.55,0.89) 


(0.45,3.11) 


phase 4 


(1,0,0) 


(4,4) 



1. 0s-200s: only multi-path user running, 

2. 200s-400s: multi-path user and one single-path user running, 

3. 400s-800s: multi-path user and both single-path users running, and 

4. 800s-1000s: only multi-path user running. 

In case of same round-trip-time, the rate of multi-path user is always 
similar to the rates of single-path users in both phase 2 and 3, Figure [3]^a). 
From Figure EJjb), we can see that when the single-path user 1 is on, the 
traffic of multi-path user is shifted to link 2 so link 1 is for the single-path 
user 1 traffic to get the fairness. In case of different round-trip-time, we can 
see in phase 3 of Figures [3]^c) that the rate of multi-path user is similar to 
the rate of the single-path user 1, which is on the shorter RTT path. The 
optimal results are given in Table 1. 

4-2. NS-2 simulations 

With the same on/off topology, in NS-2 environment, we update after 
N=100 iterations (about 10 seconds). We build our code based on the frame 



of the open source code of IETF's MPTCP, [16]. Two single-path users 
run normal Reno while the multi-path user runs our mReno. The marking 
probability scheme RED is used. 6 is calculated by averaging some last inner 
iterations in each outer step. 

Figure H] shows the rate allocation for users in cases of same round-trip- 
time and different round-trip-time. All the plots seem to follow the theoreti- 
cal results (the thick-dot lines). Similarly to Reno, mReno has fairness among 
users and discriminates against users which have long round-trip-time. 
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1 4 
3 



multi-path 

single-path 1 

single-path 2 



1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 
iterations 





multi-path 

single-path 1 

single-path 2 







1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 
iterations 



S 4 

3 



subflow 1 

subflow 2 



1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 
iterations 



(b) 



4 - 
3 



subflow 1 

subflow 2 




1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 
iterations 



(d) 



Figure 3: Rate of users and subflows of 2-bottleneck-link network, on/off users: (a-b) same 
round-trip-time, (c-d) different round-trip-time. 
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4-3. Flappiness 

Main Problem has not unique solution. For example, a network has two 
users on one bottleneck link, a single-path user and a multi-path user as 
described in Figure EJ The link capacity is 4Mbps and we consider the case 
of same RTT. We can see that all of subflow's rates which satisfy + 
£1,2 = 2 Mbps are the equilibrium points of Algorithm 1. In the packet 
level environment, the multi-path user and single-path user fairly share the 
link as shown in Figure |6]^a). However, we can see from Figure [6^b) that 
the evolutions of two subflow's rates are quite fluctuate although both of 
them are stationary in theoretical result. The reason is in the packet level 
environment, the rate of subflows vary, so 6 also varies although we had 
taken the average of several last steps of the inner iterations and the network 
gets to the new equilibrium point in the random environment. 

The flappiness of subflows in case of multiple equilibrium points is also 
described in 17, 18||. (We have a notice that the updates ( 1281) and ( 1291) have 
similar form to the coupled algorithms described in 13, formula (2)] in case 
of same RTT.) To overcome the flappiness, the authors in ItJ propose the 
semi-coupled algorithm which is modified from the fully coupled, and does 
not archive the optimum from the network utility maximization point of view. 
We also think about decoupling our mReno algorithm by fixing after the 
algorithm converge. Whenever a new user enters to the network, all the multi- 
path users which share some common links to the new user must recompute 6 
to get to a new equilibrium status for the new network conditions. Estimating 
the time to stop or start updating 6 is quite complicated. This will be our 
future works. On the other hand, we want to focus to the main subject of this 
paper is to apply the new approach of solving multi-path NUM and to build 
a framework of designing multi-path TCPs from the theoretical analysis. 
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5. Conclusions 

We apply the successive approximation framework to solve the non-separable, 
non-strictly convex NUM problem for network with both single-path and 
multi-path users. Utilizing the Jensen's inequality, we approximate the multi- 
path NUM to a separable and strictly convex problem. The solution to the 
approximation problem is proved to converge to the globally optimal solution 
of the original NUM. Based on the reverse engineering frameworks on TCPs, 
we also develop a series of multi-path TCPs that are totally compatible with 
the current TCPs. Hence, the multi-path users which running our multi-path 
TCPs can coexist with the single-path users running the current TCPs in a 
same network. The simulations on ns-2 show the coexistence and fairness of 
the among multi-path users running mReno and single-path users running 
Reno. 
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